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Abstract 

In this paper we will be concerned with a class of packing and covering problems which includes Vertex 
Cover and Independent Set. Typically, one can write an LP relaxation and then round the solution. For 
instance, for Vertex Cover one can obtain a 2-approximation via this approach. On the other hand, Khot 
and Regev [KR08] proved that, assuming the Unique Games Conjecture (UGC), it is NP-hard to approximate 
Vertex Cover to within a factor better than 2 - e for any constant e > 0. From their, and subsequent proofs of 
this result, it was not clear why this LP relaxation should be optimal. 

The situation was akin to Maximum Cut, where a natural SDP relaxation for it was proved by Khot et al. 
[KKMO07] to be optimal assuming the UGC. A beautiful result of Raghavendra [Rag08] explains why the 
SDP is optimal (assuming the UGC). Moreover, his result generalizes to a large class of constraint satisfaction 
problems (CSPs). Unfortunately, we do not know how to extend his framework so that it applies for problems 
such as Vertex Cover where the constraints are strict. 

In this paper, we explain why the simple LP-based rounding algorithm for the Vertex Cover problem is 
optimal assuming the UGC. Complementing Raghavendra's result, our result generalizes to a class of strict, 
covering/packing type CSPs. We first write down a natural LP relaxation for this class of problems and present 
a simple rounding algorithm for it. The key ingredient, then, is a dictatorship test, which is parametrized by a 
rounding-gap example for this LP, whose completeness and soundness are the LP-value and the rounded value 
respectively. 

To the best of our knowledge, ours is the first result which proves the optimality of LP-based rounding 
algorithms systematically. 
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1 Introduction 



In this paper we will be interested in a class of packing and covering problems. The class of covering problems 
we study (packing problems can be defined similarly) contains the set of problems characterized by the following 
integer program: given non-negative A e W 1X ", b e M. m , c e W, the goal is to find a vector x e {0, . . . , q — I}" such 
that Ax > b which minimizes 2, c,;e,-. In addition, each row of A has at most k non-zero entries and k and q are 
assumed to be constants. We will show that, assuming the Unique Games Conjecture, a natural linear programming 
relaxation (not the naive one) for such a problem, along with a simple rounding scheme, is the best one can hope 
for algorithmically. We start with a classic covering problem that falls in this class: the minimum vertex cover 
problem (Vertex Cover ). The equivalent packing problem is the maximum independent set problem (Independent 
Set). 



Vertex Cover. In the Vertex Cover problem, one is given a graph G{ V, E) with non-negative weights {w v } ve y for 
the vertices and the goal is to find a subset of minimum weight such that every edge has at least one end point in 
this set. We may assume that Tj V ev w v = 1- This problem is NP-hard and there is a very simple 2-approximation 
algorithm known for it. One way to obtain this approximation, which will be relevant to our work, is to solve the 
following natural linear programming (LP) relaxation. 



'Pvc(^) = minimize 
subject to 



w v x v 

veV 

Ve=uveE X u + X v > I 



Figure 1: LP for Vertex Cover 

Given an optimal solution to this LP, the rounding scheme selects vertices whose variables have value at least l /2. 
This makes sure that the picked set is a vertex cover and the cost is no more than twice lp vc (G). 

On the inapproximability side, Dinur and Safra proved that Vertex Cover is NP-hard to approximate to within 
a factor of 1.36. Khot and Regev [KR08] gave some evidence that factor 2 might be the best possible approximation 
for Vertex Cover by showing that if there is an algorithm for Vertex Cover which achieves a factor better than 
2, then the Unique Games Conjecture (UGC ) is false. However, it is not clear from their hardness reduction why 
this simple minded LP is the best one. 

One can think of Vertex Cover as a strict version of a constraint satisfaction problem (CSP). While in a CSP, 
the objective is to satisfy as many constraints as possible, in Vertex Cover , the objective is to find a solution 
satisfying all constraints while minimizing a different objective. Although the difference seems superficial, the 
algorithmic implications for the two class of problems are quite different. Let us take the example of Maximum 
Cut, the simplest and one of the most interesting CSP. Given a graph G(V, E), the Maximum Cut problem asks 
for a partition (S, S) of the vertices maximizing the number of edges going across the cut. For the Maximum Cut 
problem, the natural LP relaxation is known to give a strictly weaker approximation than a simple semidefmite 
programming (SDP) relaxation [GW95]. Further, the factor obtained by the SDP is optimal assuming the UGC 
as was shown in Khot et al. [KKMO07]. A beautiful result of Raghavendra [Rag08] manages to generalize the 
Maximum Cut result of [KKMO07] to a very general class of constraint satisfaction problems. In particular, he 
considers a generic way to write a SDP relaxation, and shows that the approximation ratio achived by the SDP is 
optimal assuming the UGC . 

However, Raghavendra's result does not seem to apply for Vertex Cover even though it is possible to think 
of Vertex Cover as a CSP in the following way: consider an instance G = (V,E) of Vertex Cover . We have 
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boolean variables x v for each v e V. For each vertex v, we have a constraint <& v (x v ) which is 1 if x v is 1 (which 
corresponds to vertex v being picked in the vertex cover), and otherwise. For each edge e = uv, we have a 
constraint *¥ e (x u , x v ) which is if at least one of x u or x v is 1, and 1 otherwise. The goal is to minimize the 
weighted sum w v <b v (x v ) + 2 ■ 2Ze=uveE( w u + w v ) ■ x v ). It is easy to argue that any optimal solution x* to 

this CSP must satisfy y ¥ e (x^, x*) = for all edges uv e E. Hence, any optimal solution to this CSP also yields an 
optimal vertex cover solution. Given this reduction from Vertex Cover to a weighted CSP, one can imagine using 
the techniques of Raghavendra [Rag08] to come up with a similar hardness result for Vertex Cover . However, 
such an argument fails to work for the following reason: the CSP corresponding to Vertex Cover has a very 
special relation between the edge constraints and the vertex constraints - the weight of each edge constraint is more 
than the sum of the weights of the corresponding vertex constraints. The reduction from UGC to such a CSP 
(which has vertex and edge constraints as defined above) will construct hard instances of such CSPs which may 
not preserve the required relationship between the weights of vertex and edge constraints. This problem seems to 
remain whenever we have CSPs where some constraints are strict, i.e., they cannot be violated. This leaves the 
understanding of problems with strict constraints as the Vertex Cover problem somewhat unsettled. 

1.1 Our Work 

In this paper, assuming UGC , we present an optimal LP-based algorithm for a class of packing and covering 
problems. First, we describe the class of covering problems we will study. This description contains the problems 
arising from the integer programming formulation described before. Here we describe the q - 2 case. 1 

Strict Monotone Constraint Satisfaction Problem. A problem n is said to be a ^-strict and monotone CSP 
(&-sm-CSP) if it consists of a set of vertices V with non-negative weights {w v } ve v on them, a set of hyperedges of 
size at most k and for every hyperedge e e E, a. constraint A e . These constraints have the following two properties 
natural for {0, l}-covering problems. 

1. The constraints are strict: the constraint corresponding to every hyperedge has to be satisfied. 

2. The constraints are monotone: given a feasible solution (a subset of vertices), adding more vertices to the 
solution keeps it feasible. 

The objective is to find a boolean assignment to the vertices so as to satisfy all the hyperedge constraints and 
minimize the weight of vertices set to 1 (selected). We denote by n^ 1; ...^ a problem in the class fc-sm-CSP if, for 
every instance of n^...^ and every hyperedge e of this instance, A e is one of the constraints [A\, . . . ,A t \. It is easy 
to observe that Vertex Cover is a special 2-sm-CSP. 

An LP for a fc-sm-CSP problem. One can define the following LP relaxation for any problem in the class k- 
sm-CSP. As written, it may not be immediately clear that it is an LP. We will prove this in Section 2.1 and for 
the benefit of the reader, we also show in the appendix (Section 6.1) how the standard Vertex Cover LP can be 
equivalently written in this form. This relaxation is inspired by the Sherali-Adams [SA90] relaxation and plays a 
crucial role in our result. 

Here, for a hyperedge e = {v\, . . . , u/}, ConvexHull(A e ) denotes the convex hull of all assignments o~ e {0, 1}' 
which satisfy the constraint A e . For an instance I, let lp( I) denote the optimum of the LP of Figure 2 for I. Also, 
let opt(J) denote the value of the optimal integral solution for I. 

'We note that for the {0, 1 j case, Hypergraph Vertex Cover are all the problems one gets in this class. Though the g-ary case, for q > 2, 
is more general, all important ideas in this paper are equally well captured by the binary case. Given this, for improved readability of this 
paper, the presentation for most of this paper is chosen to be for the (0, 1) case. In Section 5, we outline our results in the general setting of 
the g-ary alphabets. 
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Ip(J) d = minimize ^ w v x v 

(1) 

veV 

subject to Ve=( Vl ,v2,...,vi)eE (x Vl ,x V2 ,...,x Vl ) € ConvexHull(A £ ) (2) 
V„ ey < x v < 1 (3) 



Figure 2: LP for &-sm-CSP 



Main Result. The main contribution of this paper is to integrate a class of covering and packing problems in 
the same conceptual framework as done by Raghavendra for CSPs [Rag08]. We give a rounding algorithm called 
ROUND (see Figure 3) for the LP of Figure 2. For an instance I of II we first compute x* , the optimal LP-solution 
for I. For a parameter e > 0, which should be ignored for this discussion, let round(J, x* , e) denote the value 
of ROUND. We then show how to start with an instance I of II and give a Unique GAMES-based reduction for II 
whose soundness and completeness are roughly lp(J) and round(J, x* , e) respectively. We also show that ROUND 
(unconditonally) achieves an approximation ratio equal to the integrality gap, up to an arbitrarily small additive 
constant, of the LP relaxation. This can be seen as an analogue of the result of Raghavendra and Steurer [RS09]. 
We assume throughout that k = 0(1) as our reductions are polynomial-sized when k is a constant. 

Theorem 1.1. Let II be a &-sm-CSP, e > for k - 0(1), and I be an instance of TV. Then for every 6 > 0, 
assuming the UGC , it is NP-hard to distinguish instances ofU with optimal less than \p(I) + e + 8 from those with 
optimal more than round(-T, x* , e) — 5. Here x* is the optimal LP solution for I. 

def 

As a corollary we can deduce the following: we set 5 = s and note that for any instance I, round(J, x*, e) is at 
most opt(J). 

Corollary 1.2. Let H be in the class &-sm-CSP and I be an instance of IT. Then for every 5 > 0, assuming the 
UGC , it is NP-hard to distinguish instances of 'II with optimal less than \p(I) + 26 from those with optimal more 
than opt( I) - 5. 

The class &-sm-CSP falls under the class of covering problems. One can also define a similar class of problems 
for packing problems, namely Packing-/:-sm-CSP. The only differences would be (1) we would be interested 
in maximizing the total weight of vertices set to 1, and (2) the constraints would be downward monotone, i.e., 
removing some vertices from the solution would still keep it feasible. All our results translate to the setting of 
packing problems in the natural manner and we omit the details. 



1.2 Overview and Techniques 

In this section we outline the proof of Theorem 1.1. We explain the main ideas with the canonical example of 
Vertex Cover . Unlike previous work, we will be interested in instances where ROUND fails i.e., where the value 
round(J, x*, e) is much larger than lp(J). Note that this is a weaker condition than the instance being an integrality 
gap instance (as considered previously for CSPs), where the value opt(J) is much larger than lp(J). 

In particular, for Vertex Cover , ROUND performs poorly on a graph with a single edge, which is not an 
integrality gap instance because the integer optimum and the LP optimum are both equal to 1. One optimal LP 
solution is to set a value of !/2 for both the end points, and thus, satisfying the constraint corresponding to this edge. 
ROUND would then end up choosing both the end points in the cover, thus, being off by a factor 2 in the objective. 
We show a reduction from Unique Games that uses this instance to obtain a factor 2 - s hardness for Vertex Cover 
. The reduction produces the Khot-Regev graph although our analysis is conceptually simpler and uses the, by now 
standard, Invariance Principle. Note that the inapproximability obtained is at least as good as the integrality gap of 
the LP because the optimal solution is at least as good as the one output by ROUND. 
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Given an instance of Vertex Cover along with an LP solution, we prove that the best rounding scheme, 
assuming the UGC, is one which sets the variables to 1 or by solely looking at the value of the variables. We 
do so by picking a Unique Games instance and replacing each vertex of the unique game with several blocks of 
vertices, one for every distinct value the LP solution takes (one can think of having one block for every variable in 
the LP, but we will later need to identify variables taking the same value). We then introduce constraints across the 
blocks inspired by the LP solution such that if the Unique Games instance has a good labeling, then there is a way 
to choose a fraction of each of the blocks such that all the edges are covered. Further, the fraction selected in each 
block has measure exactly equal to the total value of the corresponding variables in the LP solution. 

Next, we show that if the Unique Games instance has no good solution, then any solution can be converted to 
a solution that either completely chooses a block or ignores it completely while losing only a small additive error 
in the objective. We use the Invariance Principle and gaussian stability estimates to prove that if a particular block 
is partially selected, then, there are a bunch of constraints that are completely contained in the unselected part. 
Thus, given that the solution satisfies every constraint (covers all edges), the partially selected blocks might as well 
have been completely unselected without violating any constraint. If we think of selecting a block as setting the 
corresponding variable to 1 and not selecting as setting it to 0, this naturally corresponds to a rounding of the LP 
solution solely based on the value of each variable: exactly the space of solutions ROUND searches over. 

As it is, this does not say much since the LP value could assign completely distinct values to all the variables. 
However, we can always convert such an LP solution to one that takes only a constant ( 1 /e) number of distinct 
values while losing a small additive error (e) in the objective. This naturally gives a rounding scheme, which as 
the first step discretizes the LP solution to have a small number of distinct values before trying out every possible 
rounding of the values. The rounding scheme remains exactly the same for the general version: solve the linear 
program, fix the solution to one with a small number of distinct values and then exhaustively search over all possible 
roundings of the values. 

1.3 Further Discussion and Related Work 

LP inspired hardness results. There are several problems for which the best known inapproximability results 
have been obtained as follows: first construct integrality gap instances for the standard LP relaxations for these 
problems and then use these instances as guides for constructing hardness reductions based on standard complexity 
theoretic assumptions. These reductions yield inapproximability ratios quite close to the actual integrality gaps. 
Examples include Asymmetric ^-center [CGH + 04], Group Steiner Tree [HK03] and Average Flow-time on Par- 
allel Machines [GK07]. Assuming UGC , our result proves hardness of a large class of problems in a similar spirit. 
However, instead of explicitly constructing integrality gap examples for such problems, we give a more direct and 
intuitive proof that the integrality gap is close to the actual hardness of such problems. We note that the only other 
result for LPs similar in flavor as ours, though unrelated, is that of [MNRS08] for Multi-Way Cut. 

Unique Games Conjecture. Since its inception, the UGC of Khot [Kho02] has been used to obtain a host of 
inapproximability results [Kho02, KV05, CKK+06, KKMO07, KR08, MNRS08, GMR08, Rag08, CGM09] and, 
it implies optimal hardness of approximation results for problems such as Maximum Cut [KKMO07] and Vertex 
Cover [KR08, BK09]. 

Very recently, for the problem of Vertex Cover , a similar analysis using the Invariance Principle was also 
proved by Austrin, Khot and Safra [AKS09]. They were motivated by the problem of proving hardness of approx- 
imating Vertex Cover on bounded degree graphs where as the goal of this paper is to establish the optimality of 
LP-based algorithms for problems similar to Vertex Cover . 
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1.4 Rest of the paper. 

In Section 2, we give a detailed outline of the proof of Theorem 1.1. In Section 2.1 we formally define the class 
of problems we shall be interested in. In Section 2.2, we outline the properties of the dictatorship test which leads 
to the proof of Theorem 1.1. We describe the rounding algorithm and prove its optimality in Section 3. We give 
all the details of the construction and the properties of the dictatorship test in Section 4. This requires us to prove 
some properties of a feasible solution to the LP, which we describe in Section 4.1. The actual reduction from UGC 
to a problem in the class &-sm-CSP builds on the construction of the dictatorship function in a standard manner - 
we describe this in the appendix (Section 6.5). We describe the setting of the q > 2 case in Section 5. 

2 Proof of Theorem 1.1 

In this section we will reduce the task of proving Theorem 1 . 1 to constructing a dictatorship test. Once we have 
stated the claim for the dictatorship test, it would be standard to convert it into a UGC -based hardness result and 
deduce Theorem 1.1. The soundness of this dictatorship test, in turn, relies on the rounding algorithm ROUND of 
Figure 3 which is described in Section 3. We start with some necessary preliminaries to describe the problems and 
the LP we will consider for them. 

2.1 Preliminiaries 

Given distinct x, y e {0, \} k , we say y > x, if for every i e [k], yi > X/. Further, a subset A c {0, 1}* is said to be 
upward monotone if for every x e A, and every y such that y > x, it follows that y e A. 

Definition 2.1 (The class &-sm-CSP). Let k be a positive integer. An instance of type &-sm-CSP is given by 

I = (V, E, {A e } [em , {w v } ve v) where : 

- V = {vi,V2, ■ . ■ ,v n } denotes a set of variables/vertices taking values over {0,1} along with non-negative 
weights such that zZvev w v = 1. 

- E denotes a collection of hyperedges, each on at most k vertices. For each hyperedge e e E, there is a 
constraint A e which is an upward monotone set denoting the set of accepted configurations of the vertices in 
e. 

The objective is to find an assignment A : V i-» {0, 1} for the vertices in V that minimizes zZvev u> v A(v) such that for 
each e = {v\,V2,..., vj), (A(»i), . . . , A(i>/)) 6 A e . A fc-sm-CSP IT is given by upward monotone sets {A\, . . . ,A t ). 
Every instance of II is supposed to have its constraints for the hyperedges to be one of {A\, , . ., A t }. For simplicity, 
we will assume that the size of each hyperedge is exactly k. Our proofs also hold when hyperedges have size at 
most k. 

Definition 2.2. For a set A c {0, \ } k , define ConvexHull(A) as the convex hull of elements in A. Note that any 
element x £ ConvexHull(A) can be expressed as Z^a-eA ^<r ' o~i where Aq- can be thought of as giving a probability 
distribution over elements of A. 

The LP relaxation for &-sm-CSP appears in Figure 2. On an instance I and a feasible solution x to LP(J), we 
will let val(J, x) to denote the objective of LP(J). We now show that this indeed is an LP by explicitly writing 
the constraints (2) as linear constraints. Consider an edge e - (u\,...,Uk) € E. We define variables X%., where 
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cr g {0, 1 \ k and it varies over all elements of A e . The constraint (2) can now be written as 

creA e 

v«a, 4 > o 

<T€A e 

In the appendix (Section 6.1), we show that for the Vertex Cover and Hypergraph Vertex Cover problems, 
this LP is at least as strong as the standard LP relaxations for these problems. 

2.2 Dictatorship Function 

We now describe the properties of the dictatorship test. In fact, we prefer to refer to it as a dictatorship function as 
it takes some inputs and has an output rather than an acceptance predicate. 

Our dictatorship function DictS (r, 5) takes as input an instance J of a problem n, a solution x to the LP 
relaxation (Figure 2) for this instance, and parameters m, r and 6. r would be the label set size of the Unique Games 
instance we combine this dictatorship function with to get the actual reduction for Theorem 1.1 and can be ignored 
for now. m is an upper bound on the number of distinct values the entries in the vector x are allowed to take. We 
will often refer to e as i/m-i. 8 is a smoothening parameter, essential for the application of the Invariance Principle, 
and can be ignored for now. The dictatorship function outputs another instance D of II. The vertex set V(D) of this 
instance would be [m] x {0, \ } r and we defer the precise description of the output instance for Section 4.2. Recall 
that round(J, x, s) denotes the value of the rounding algorithm ROUND(J, x, e). Even though we will describe the 
algorithm in the next section, for now, it is sufficient to know that the algorithm produces an integral solution for I 
from a feasible solution x to LP( I) after it has perturbed x and made sure that its variables take at most m distinct 
values. In particular, round(J, x, s) < opt(J). Now, we can state the main claim regarding our dictatorship function. 

Lemma 2.3. (Informal Version) The dictatorship function Dictv (r, 6) has the following properties: 

1. Completeness: There are r "dictator" assignments to V(D) each of which satisfy all the constraints of D 
and each costs at most val(J, x) + 5. 

2. Soundness: Every assignment which is "far from being a dictator" assignment and satisfies all the con- 
straints in D must have cost at least round(i", x, e) — 5. 

We leave the precise definition of "dictator" and "far from being a dictator" for Section 4.2. The proof of this lemma 
also appears in Section 4.2. For a fixed instance I, to maximize the gap between val(J, x) and round( I, x, e) one 
should use x = x*, the optimal solution to LP(J). The problem is that, then, we are not guaranteed that the variables 
in x* takes at most m distinct values. But this is easy: since the variables take value between and 1, one can just 
bucket them into bins of width s and lose only an additional e in the completeness in the lemma above. Hence, we 
can obtain the following corollary. 

Corollary 2.4. The dictatorship function Dict^ 1 ^ (r, 5) has the following properties: 

1. Completeness: There are r dictator assignments to V(D) each of which satisfy all the constraints of D and 
each costs at most lp(X) + e + 6. 

2. Soundness: Every assignment which is "far from being a dictator" assignment and satisfies all the con- 
straints in D must have cost at least round(J, x*, e) - 5. 

Here x* is the optimal LP solution for I. 
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The corollary above can be converted to a Unique GAMES-based hardness result for IT. The following is just a 
reformulation of Theorem 1.1 and will be proved formally in Section 6.5. 

Theorem 2.5. Let IT be a &-sm-CSP, e > Ofor k - 0(1), and I be an instance ofH. Then for every 5 > 0, given 
an input instance {J of TV, assuming the UGC , it is NP-hard to distinguish between the following: 

1. Completeness: opt(J") < lp(J) + s + 5. 

2. Soundness: opt(J~) > round(J, x* , e) - 8. 

Here x* is the optimal LP solution for I. 

3 The Rounding Algorithm and its Optimality 

In this section we describe our rounding algorithm ROUND and prove that it achieves the integrality gap uncon- 
ditionally. Theorem 1.1 implies that it is not possible to beat this integrality gap assuming the UGC . Hence, this 
algorithm is optimal. 

The algorithm. The algorithm will use a parameter s. We assume without loss of generality that 1 /e is an integer. 
We first define a way of perturbing a solution x to LP(J) (Figure 2) such that the number of distinct values the 
variables of x take is at most i/« + 1 • 

Definition 3.1. Given an x such that < x u < 1 for all u e V, and a parameter s > 0, define x E as follows - for each 

def 

u e V, let k„ be the integer satisfying k u s < x u < (k u + l)e, then x^ - (k u + l)e (if x u = 0, we define xf t to be as 
well). 

In other words, X s is obtained from x by rounding up each coordinate to the nearest integral multiple of s (note that 
this value will not exceed 1 because 1 /e is an integer). First we observe the following simple fact. 

Fact 3.2. Let x be a feasible solution to LP(J). Then 

1. x E is feasible for LP(J). 

2. val(J, X s ) < val(J, x) + s. 

The proof this fact appears in the appendix (Section 6.2). 

The algorithm ROUND is described in Figure 3. This algorithm takes as input an instance I, a feasible solution 
x to LP(J) and a parameter s > 0. We denote round(J, x, e) as the value of the integral solution returned by 
ROUND(J, x, e). First, the algorithm perturbs x to X s to make sure that the number of distinct values taken by the 
variables in x £ is at most m = 0( l /e), which is to be thought of as a (large) constant. Thus, the variables fall into m 
buckets and now, the rounding algorithm goes over all possible assignments to these constantly many buckets and 
outputs the assignment with the least cost. 

The optimality of the rounding algorithm. We quickly observe that ROUND achieves the integrality gap. 
Lemma 3.3. Let y*(TT) be the worst-case approximation ratio (integrality gap) achieved by the LP relaxation for 

def 

the problem IT, i.e., y*(TT) - supj(opt(J)/lp(i~)), where the supremum is taken over all instances I ofU. Then, for 
any given instance J~, optimal LP solution x and e > 0, round(^T, x, e) < y*(TT) • (opt(^T) + e). 
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Proof. Consider an input (J~, x, e) to the algorithm ROUND. We define a new instance J - ' of IT as follows: the set 
of variables V' - {0, . . . , l /s + 1} and hyperedge set E' = . . . , 4) | (v\, . . . , v^) £ E and xf t . = ij ■ s for allj e [k]}. 
We take the weight u>i of i e V to be Z_^ =(£ and take constraint A e > for an edge e' e E' to be the same as A e for 
the corresponding edge in e e E. Then, since ROUNDS, x,s) searches over all feasible assignments to variables 
in J' , we get that roundCJ, x, e) = optCJ')- Hence, we get 

Fact 3.2-(2) 

roundCJ, x, s) = optCJ') < f(U) ■ \p(J') < y*(U) ■ (\p(J) + e) < /(IT) • (optCJ) + s). 

□ 



Input: An instance I - (V, E, {A e } e6 £, {w v } ve =v) of a problem in &-sm-CSP, a feasible solution x to LP(J) and 
a parameter e > 0. Let m := 1 /e. 

Output: A labeling A : V h-> {0, 1}. 

1. Construct the solution X s . 

def 

2. For every z € {0, 1}"', construct a 0-1 solution A z as follows : A~ = Zj if x £ u - je. 

3. Output the solution A z * which has the smallest objective value among all feasible solutions in {A z |z e 
{0,1}"'}. 



Figure 3: Algorithm ROUND 



Deducing the Khot-Regev result. As an application of Theorem 1.1, we prove the result of Khot and Regev 
[KR08] which states that assuming UGC , it is NP-hard to get (&-e)-approximation algorithm for the &-Hypergraph 
Vertex Cover problem for any constant e > 0. Consider the following instance I of &-Hypergraph Vertex Cover 
- we are given a set V of size k, and there is only one hyperedge in E, namely, the set of all vertices in V. The 
weight of every vertex is l /k. Consider the solution x which assigns value V* to all variables x u . It is easy to check 
that it is feasible to our LP relaxation. The value of the solution x is l /k. . Let us now see how the algorithm 
ROUND(J, x, e), where e < V(t, rounds the solution x. All entries in x s will still be same. Hence, the rounding 
algorithm will consider only two options - either pick all vertices in V, or do not pick any vertex. Since the 
latter case yields an infeasible solution, it will output the set V, which has value 1 . Theorem 1 . 1 now implies that 
assuming UGC , it is NP-hard to distinguish between instances of &-Hypergraph Vertex Cover where the optimal 
value is at most ^/k-le from those where the optimal value is more than 1 -s. Note that the integrality gap of LP(J) 
is 1. Still we are able to argue hardness of &-Hypergraph Vertex Cover problem starting from such an instance 
because the algorithm ROUND performs poorly on this instance. In this sense, the statement of Theorem 1.1 is 
stronger than that of Corollary 1 .2. 

4 Dictatorship Function 

In this section we give details of the dictatorship function. The dictatorship function takes as input an instance 
I of the problem, a feasible solution x to lp( J) and parameters m, 6 and r. The entries in the solution x take at 
most m distinct values. The parameter r is related to the label size in the Unique Games instance that is used for 
the reduction, and can be assumed to be an arbitrary quantity for this discussion. The output of the dictatorship 
function is another instance D of the same problem. The vertex set of this instance is [m] x {0, 1}' , which we can 
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think of as m blocks. The hyperedges in T> are constructed roughly as follows - for every hyperedge e in the input 
instance I, we pick r hyperedges from the set A e by a randomized process. We use these r hyperedges to construct 
one hyperedge in D which spans across k suitably chosen blocks in £). The set of hyperedges in D consist of 
hyperedges which can be obtained in this manner with strictly positive probability. Note that even though these 
probabilities are not explicitly required for the description of D, they are still useful for the soundness analysis of 
the dictatorship function. 

Given a hyperedge e in the instance I, the probabilities with which we select r edges from A e are obtained 
by using the fact that x is a feasible solution to lp(J). This allows us to express x as a convex combination of 
elements in A e and the coefficients in this convex combination give us the requisite probabilities. The analysis of 
the dictatorship function uses the Invariance Principle, which requires that the minimum non-zero probability of 
an element in A e is not too small, and a suitably defined "conelation graph" is connected. We achieve these two 
properties by using the parameter 8 to "smoothen" the probabilties obtained from the solution x. We now define 
these probability distributions and their smoothenings more formally below. 

4.1 Probability Distribution from the LP solution 

We define the notion of smoothening the distribution obtained by restricted x to a hyperedge e. 

Definition 4.1. Let x be a feasible solution to LP( I). For a hyperedge e, let x\ e be the vector obtained by restricting 
x to only those vertices which belong to e. P x e shall denote the probability distribution over the vectors in {0, 1}* 
corresponding to elements of A e that arises from the fact that x\ e 6 ConvexHull(A e ). For a parameter 8 > 0, define 
a random function R s : {0, 1}* h-> {0, \} k which satisfies the following property independently for each i : 

nS, ^ def ( Xj with probability 1 - 8 
~ 1 1 with probability 8 

Now define a distribution M${P X ) over {0, 1 } k where 

M s {P*){z) = P \R\z') = z] , 

where z' is drawn according to distribution P x e and R s from the space of function from {0, 1 } k to {0, 1 } k as described 
above. 

Remark 4.2. Note that for a hyperedge e, the support of P x e is a subset of A e . Since A e is upward monotone, the 
same fact holds for Ms(P x ) as well. 

Definition 4.3. Let P be a distribution on {0, 1 } k . Define margin ; (P), 1 < i < k as the following distribution on 
{0,1}: 

margin,.^) d = £ P(b u . . . , b t - X ,b,b M , • ■ • , h). 

bi,...,bi-i,h+u-M 

The following fact, whose proof is easy to check, shows that the marginals of the distributions P x e and Ms(P x ) on a 
single coordinate can be easily expressed in terms of x. 

Fact 4.4. Let e = (u\ u^) by a hyperedge in an instance I. Then, E marg i n .(pi)(&) = x Uj , and E marg i n .(^(pj))(^) = 

(1 - 8)x Ui + 8. 

Fact 4.5. For a hyperedge e, let a denote min^fP^oj) : P x (u>) > 0}. Then min^M^CP;^)) : M s (P x (a>)) > 0} is at 
least 8 k ■ a. 
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A feasible solution x satisfies the property that (x ui , . . . , x Uk ) can be expressed a convex combination of vectors in 
A e for every e = (u\, . . . ,u%) e E. The following lemma shows that under some conditions on x, the non-zero 
coefficients of this convex combination are large enough. This shall be useful in our application of the Invariance 
Principle. We defer the proof to appendix (Section 6.3). 

Lemma 4.6. Let A be a upward monotone subset of {0, 1}* and let (x\,x%, . . . , Xk) £ ConvexHull(A) such that 
each x u is an integral multiple of s (assume that l /e is an integer). Then, there is a distribution P over A such that 
the minimum probability of any atom in P is at least ^fy. 

4.2 Description and Properties of the Dictatorship Function 

In this section, we first describe the parameters of the dictatorship function and the output instance that it produces. 
Then we give a more formal statement of Lemma 2.3 in Lemma 4.9 and Theorem 4.10. We then prove these and 
hence, complete the proof of Lemma 2.3 and Corollary 2.4. For < I < 1, let z<— pc denote a string drawn from 
the ^"-biased distribution on {0, 1}'". 

Parameters of DictV (r, 6). 

1. Starting Instance. An instance I = (V = {u\, . . .,u n },E, {A e } eeE , {w u } ueV ) of n. 

2. Solution to LP( I). A vector x = (x ln , . . . , x Mn ) which is a feasible solution to LP(J). 

3. Multiplicity Parameter, m denotes the number of distinct values in the vector x and let p\, . . . , p m denote these 
distinct values. Let B : V i-> {1, 2, . . . ,m) such that B(u) :— b whenever x u = pb for some b e {1, ... , m\. 

4. Smoothening Parameter. 5 > 0. For a feasible solution x to LP(J) and for every edge e e E, we use this 
parameter to define the distribution Ms(P x e ). The solution x shall satisfy the conditions of Lemma 4.6, and, 
hence, Fact 4.5 implies that the minimum probability of an atom in Ms(P*) is at least |^f. 

5. Repetition Parameter. A positive integer r. (r would be the size of the label set of the Unique Games instance 
to be used in the hardness reduction.) 

The Output Instance. Dict^ (r, 6) outputs the following instance D of II 

1. Vertex Set. The vertex set of D is V(D) := [m] x {0, l} r . 

def 

2. Weights on Vertices. Let pt = pb(\ - 8) + 6 for b e {1,2, ... , m). The weight of a vertex (b, y) e D, 



Note that since, 2»ey w u = 1, Zvevm = 1- 

3. Hyper-edges and Constraints. The set of constraints in D is the union of every constraint output with 
positive probability by the following procedure: 

(a) Pick a random hyperedge e = (u\, ui, . . . , u^) from I and let A e denote the constraint corresponding to 
it. 

(b) Sample r independent copies (z J Ul ,z J U2 ,..., z J Uk ) r =l from the distribution M S (P*). 




w, 



ueV\x„=p b 
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(c) Let the corresponding hyperedge in D be 

(4,4,. (4^ 

and the constraint corresponding to it be A e . 
We now define the notions "dictator" and "far from being dictator", and then give formal statements of Lemma 2.3. 
Definition 4.7. A set S c [m] x {0, l} r is said to be a dictator if there exists an i e [r] such that S = {{b,z) '■ Zi = 1}- 

For aXc [m] x {0, 1 } r , define S h d = S n (ft, {0, 1 }')■ Further, define functions : {0, 1 } r \-> {0, 1 } to be the indicator 
function of the complement of Sb- We refer to a subset of vertices of D of the form (ft, {0, l} r ) as the hypercube 
corresponding to b. Given i e [r],b e [m], the degree rf-infiuence of the i-th coordinate of fjj, lnff d (f^) with 
respect to the measure pp b is defined in Section 6.4.1. 

Definition 4.8. Given t, d > 0, a set S c [m] x {0, 1 }'" is said to be (t, d)-pseudo-random if for every ft e [m] and 
every / e [r], Inff^) < t. 

Now we state the completeness and soundness properties of the dictatorship function. 

Lemma 4.9. (Completeness.) Suppose S c [m] x {0, 1}'' is a dictator. Then S satisfies all the constraints of D and 
w D (S) <va\(I,x) + 6. 

Observe that if we take the optimal solution x of lp( I) and use the corresponding perturbed solution x £ as input to 
the dictatorship function, then Lemma 4.9 combined with Fact 3.2 implies the first statement in Corollary 2.4. 

Theorem 4.10. (Soundness.) For every small enough 6 > 0, there exists ad,T such that ifS c [m] x {0, l} r satisfies 
all the constraints of D and is (r, d)-pseudo-random, then 

w<d(S ) > round( I, x, s) - 6. 

The construction of the dictatorship function can be extended to give a reduction from Unique Games to a problem in 
the class fc-sm-CSP. The completeness and soundness of the dictatorship function translate to that for the reduction, 
which allows us to prove Theorem 2.5. We describe this reduction in the appendix (Section 6.5). 

Proofs of Completeness and Soundness Properties. Now we give proofs of Lemma 4.9 and Theorem 4. 10. 

Proof of Lemma 4.9. Let i be such that S - {(ft, z) '■ Zi =1}- For any hyperedge e e E, recall that the support of 
Mg(P'l) is a subset of A e . Hence, any (z m , Z U2 , ■ ■ ■ , z Uk ) <— M§(P x e ) always satisfies the constraint A e . Thus, the set S 
satisfies every constraint of the instance D. The total weight of the set S is 

wd(S) = Zj w " = Zj P h Zj W " = .Xj WuX *Q ~ ^ + 6 - val (-^>*) + 6 - 

be[m]zki=l u\x„=p b be[m] u\x„=p b u 

□ 

We now prove the soundness of the dictatorship test. The crux of the proof is to show that given a subset S c 

def 

[m] x {0, \ } r satisfying all the constraints in D, one can find a subset / c [m] such that Tj - U^, e /(ft, {0, l} r ) 
satisfies all the constraints in D and u)£)(Tj) < W£>(S) + 8. 
Proof of Theorem 4.10. Define 

J A ^ib\ E f b {z)<6\. 
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Fix a particular hyperedge e = (wi, u 2 , . . . , u^) £ E of the instance I. Let 

R e A = {ui € e \B{ui) $ J). 

We will deduce the following fact from the Invariance Principle of Mossel [Mos08]. We give a detailed description 
of the Invariance Principle in the appendix (Section 6.4.1). The proof of the following fact is also deferred to the 
appendix (Section 6.4). 

Fact 4.11. 

E[n ueR j s B(u) (z w )}>o. 

In the expectation above, the argument zf- u > of is chosen with the pB(„)-biased measure on {0, l} r independently 
for each u e R e . Since f£ e {0, 1} and, in particular non-negative, for each b e [m], this fact implies that there is a 
hyperedge in D that queries the hypercubes corresponding to (u\, U2,..., uu) at z^ Ul \ ■ ■ - , v"*' respectively such that 
for every u £ R e , f^iz ) = 1. Since f£ is the indicator of the complement of Sb, this means that the constraint 
was satisfied solely by the hypercubes in J. Thus, all the constraints of D would also be satisfied by the set Tj. 
Note that since Tj selects hypercubes that are already 1-6 fraction covered by S , W£,{Tj) < w%)(S) + 6. 

Further, since T j either completely chooses a particular hypercube or completely ignores it, this corresponds 
to one of the assignments that the rounding algorithm iterates through on the input (I, x, s). This implies that 
round( I, x, e) is at most w<d(Tj). This completes the proof of the theorem. □ 



5 Extension to larger alphabets 

In this section, we show how our results can be easily extended to the case when variables take values from a larger 
alphabet [q] = {0, ...,q- 1}. 

Problem Definition. Given x, y £ [q] , we say that y > x, if, yi > x\ for all i, 1 < i < k. A set A c [q] k is said to 
be upward monotone if for every x £ A, and every y such that y > x, it follows that y e A. For sake of brevity, we 
assume that the alphabet size, q, is implicit in the definition below. 

Definition 5.1 (The class &-sm-CSP). Let k be a positive integer. An instance of type &-sm-CSP is given by 

I = (V,E, {A e } {eeE \, {w v } v ev) where : 

- V = {v\,V2, . . . ,v n } denotes a set of variables/vertices taking values over [q] along with non-negative weights 
such that Y>vev w v - 1- 

- E denotes a collection of hyperedges, each on at most k vertices. For each hyperedge e e E, there is a 
constraint A e which is an upward monotone set denoting the set of accepted configurations of the vertices in 
e. 

The objective is to find an assignment A : V i-» [q] for the vertices in V that minimizes Yjuev w v A(v) such that for 
each e = (v\,V2,..., v{), (A(»i), . . . , A(i>/)) £ A e . A &-sm-CSP n is given by upward monotone sets {A\, . . . ,A t \. 
Every instance of II is supposed to have its constraints for the hyperedges to be one of {Ai, . . . , A t \. As in the binary 
case, we will assume that the size of each hyperedge is exactly k. Our proofs continue to hold when hyperedges 
have size at most k. 
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LP relaxation We now give an LP relaxation for a problem in &-sm-CSP. The following definition allows us to 
map values in [q] to vectors whose coordinates lie between and 1. 

Definition 5.2. Let A q denote the set of vectors { (zo, . . . , z q -\) : Zi > for all i € [q] and E/sfe] Zi = 1 )■ There is a 
natural mapping x ¥ q : A q h> [q] defined as *P ? ((zo. • • • <z q -i)) = 2ie[?] Zi ' Let e,-, for / £ [g], be the unit vector in 
which has value 1 at coordinate i, and elsewhere. It is easy to check that A q is the convex hull of the vectors 
{e\ : i € [q]}. It follows that a vector x e A q can also be thought of as a probability distribution over [q]. 

Definition 5.3. Given an integer i e [q], define $> q (i) as the vector e,- e M. q . Given a sequence cr e [q] k , for some 
parameter k, define 9 (cr) - (® q (cri), O q (cr k )). Note that <3> q (cr) is a vector in W' k . 

The LP relaxation for an instance J of a problem fl e &-sm-CSP is described in Figure 4. 



lp(J) d = minimize J^w^^x,) (4) 

veV 

subject to V e =(v u v2,...,v k )eE (xvi ,x V2 ,..., x Vk ) e ConvexHull(A e ) (5) 

V„ e v x v € A q (6) 



Figure 4: LP for yt-sm-CSP 

Here, ConvexHull(A e ) is the convex hull of the set {O^(cr) : cr is a satisfying assignment for A e }. It is easy to 
check that this indeed is a linear program. Given a solution x to LP(J), let val( I, x) denote the objective function 
value for x. 

The Rounding Algorithm. We now describe the rounding algorithm. The algorithm uses a perturbation parame- 
ter e. We first argue that we can perturb a feasible solution to LP(J) such that the number of distinct (vector) values 
taken by the variables are small. This perturbation will not affect the objective value significantly. We shall assume 
without loss of generality that l fe is an integer. 

Definition 5.4. For a parameter e > 0, define A q '',0 < i < q, as the set of points z € A q satisfying the following 
conditions - (1) zo, ■ ■ ■ , Zj-i are multiples of e, and (2) z.i+i = ■ ■ ■ = z q -\ - 0. Observe that zt must equal 1 - YIJ=q Zj- 
Let A q denote \JiA q l . 

It is easy to check that |A^| is at most V(e+i) ? . We now show how a vector x e A q can be perturbed to a vector in A q . 

Definition 5.5. Let a e [0, 1] be a real number. Define a E as the smallest multiple of s greater than or equal to 
a. Consider x 6 A q . Let i be the largest integer such that + • • ■ + jcf_j < 1. Then, define x £ to be the vector 
(x^,...,xf_ 1 ,l-i:;- = 1 o40,...,0)eAf. 

The rounding algorithm is described in Figure 5. Let round^J, x, e) denote the objective value of the solution 
returned by ROUND 9 (J, x, e). 

Since m q is 0{ Y le q ), the running time of ROUND^ is 0{^o\y{n k , V^))- We state the following fact without proof. 
Fact 5.6. Let x be a feasible solution to LP(X). Then 

1. x E is feasible for LP(J). 

2. val(J, x £ ) < val(J, x) + e ■ q 2 . 
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Input: An instance I - (V, E, {A e } ee E, {w v } ve v) of a problem in fc-sm-CSP, a feasible solution x to LP(J) and 
a parameter e > 0. Let m q denote |A*|. 

Output: A labeling A : V i-> [q] . 

1. Construct the solution X s . 

2. Let / denote the set A^ arranged in some order. 

def 

3. For every z £ [<?]'"'', construct an integral solution A z as follows : A z u - Zj if x £ u - Ij. 

4. Output the solution A z which has the smallest objective value among all feasible solutions in {A z \z e 
[q] mq l 



Figure 5: Algorithm ROUND,, 
Probability Distribution from a Feasible Solution. 

Definition 5.7. Let x be a feasible solution to LP( I). For a hyperedge e, let x\ e be the vector obtained by restricting 
x to only those vertices which belong to e. P x e shall denote the probability distribution over vectors in A k q corre- 
sponding to elements of A e that arises from the fact that x\ e e ConvexHull(A e ). For a parameter 5 > 0, define a 
random function R s : A k q i-» A* which satisfies the following property independently for each i : 

fids \ d £ f | x i w ^ probability 1-5 
| e q -i with probability 5 

Now, define a distribution Ms(Pg) over A^ where 

M 6 (P x e )(z) = P z .^[R s (z') = z\, 

where z' is drawn according to distribution P x e and R 6 from the space of function from A k q to A^ as described above. 

Definition 5.8. Given a vector p e A q , let fi p be the corresponding distriution over [17] (as described in Defini- 
tion 5.2). 

The Dictatorship Function. We now describe the parameters of the dictatorship function and the output instance 
that it produces. 
Parameters of Dict 1 ,! (r,6). 

1. Starting Instance. An instance I - (V - {u\, . . .,u n },E, {A e } e€E , {w u } ueV ) of n. 

2. Solution to LP(J). x = (x Ul ,.. ., x Un ) which is a feasible solution to LP(J). 

3. Multiplicity Parameter, m denotes the number of distinct (vector) values in the vector x and let p\,... ,p m 
denote these distinct values. Note that pi e A q for all i. Let B : V i-> {1,2, ... ,m) such that B{u) := b 
whenever x„ = pi, for some b € {1, . . . , m}. 

4. Smoothening Parameter. S > 0. For a feasible solution x to LP(J) and for every edge e e E, we use this 
parameter to define the distribution M§{P x e ). 
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5. Repetition Parameter. A positive integer r. (r would be the size of the label set of the Unique Games instance 
to be used in the hardness reduction.) 

The Output Instance. 

DictJ (r, S) outputs the following instance D of n 

1. Vertex Set. The vertex set of D is V(D) := [m] x [q] r . 

def 

2. Weights on Vertices. Let p h = (1 - 6) ■ pb + 6 ■ e q -\ for b e {1, 2, . . . , m). The weight of a vertex (b, y) e D, 

WD((b,y)) d = np b (y) w u . 

ueV\x„=p b 

Note that since, J^uev ™u = L Z«eV(£>) = 1. 

3. Hyper-edges and Constraints. The set of constraints in D is the union of every constraint output with 
positive probability by the following procedure: 

(a) Pick a random hyperedge e = (u\, U2, . ■ . , ut) from I and let A e denote the constraint corresponding to 
it. 

(b) Sample r independent copies (z J Ul ,zi 2 ,---, zi k Yj =l from the distribution M§{P x e ). 

(c) For each j — 1, . . . , r, let (y J u ,y J u , . . . , y J u ) e [q] k be a random sample from the distribution p j x p. j x 
• • • X fij . 

(d) Let the corresponding hyperedge in D be 

(yl, y r Ul )) , (B{u 2 ), (y l U2 ,y 2 U2 , y r Ul )) (B(u k ), {y l Uk ,y 2 Uk ,. . . , y r Uk ))) 

and the constraint corresponding to it be A e . 

Properties of the Dictatorship Function. 

Definition 5.9. An assignment / : [m] x [q] r i-> [q] is said to be a dictator if there exists an j e [r] such that 

f(b,z)=Zj. 

Given b e [m], let ft, denote the restriction of / to (b, [q] r )- Given p € A q , let z<^p r p denote a string in [q] r drawn 
from the product distribution p r p . We can think of an assignment % : [q] r h> [q] also as a a function from [q] r to 
(where the value i € [q] gets associated with e A q ). Given j e [r],b e [m], the degree <i-influence of the j-th 
coordinate of fi,, Infj rf (/ fe ) is defined as in Section 6.4.1. 

Definition 5.10. Given t, d > 0, an assignment / : [m] x[q] r \-> A q is said to be (t, d)-pseudo-random if for every 
b e [m] and every ; e [r], lnfj d (f b ) < t. 

Now we state the completeness and soundness properties of the dictatorship function. 

Lemma 5.11. ( Completeness.) Let f : [m] X [q] r \- > [q] be a dictator. Then f satisfies all the constraints ofD and 
XveV(D) wd(v) ■ f(v) < val( I, x) + O q {8). 

Theorem 5.12. (Soundness.) For every small enough 5 > 0, there exists a d,r such that if f : [m] x [q] r i-> [q] 
satisfies all the constraints ofD and is (t, d)-pseudo-random, then 

2 w o( v ) ■ f( v ) ^ round 9 (J, x, s) - Q. q (5). 

veV(D) 
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We note that the proof of this theorem is almost identical to that of Theorem 4. 10. Here we outline the changes to 
be made in the q > 2 case. The crux of the proof is to show that given a subset / : [m] x i-> [q], satisfying all 
the constraints in G, one can find a function g : [m] x [q] r t-> [q] such that g depends only on b e [m] (g is constant 
on every cube), g satisfies all the constraints in D and zZveD w x>( v ) ' 9(. v ) ^ 2ZveD w d(v) • f(v) + O q {8). To obtain g, 
the strategy would be to look at the cube {b} x [q] r , find the smallest i e [q] such that 

E fbM>5. 

Here, f,j : [q] r t-> {0, 1} denotes the indicator of the event that fb,i(z) = 1 if f(b,z) = i and otherwise. We would 
then define g(b, z) = i for all z £ [qY- Thus, g has the desired form. Using the fact that / is d, r-pseudorandom, one 
can now appeal to the Invariance Principle in the g-ary setting, as in Theorem 4. 10, to obtain that g still satisfies all 
the constraints in G. Note that 2Z v eV(D) w o(v) • 9( v ) ^ TjveV(D) w d(p) ' f( v ) + 8 • q. Further, since g corresponds to 
integral assignments to every cube, this corresponds to one of the assignments that the rounding algorithm iterates 
through on the input (I, x, s). This implies that round^J, x, s) is at most zZveV(D) u>d(v) ■ g(v). This completes the 
sketch of proof of the theorem. 



Unique Games Conjecture based Hardness Results. The following are equivalent to Theorem 1 . 1 and Corol- 
lary 1.2. 

Theorem 5.13. Let H be a &-sm-CSP on alphabet [g], e > 0/or k - 0(1), and I be an instance ofli. Then for 
every 5 > 0, assuming the UGC , it is NP-hard to distinguish instances ofU with optimal less than lp( I) + e + O q (6) 
from those with optimal more than round ? (i~, x*, s) — 9 (<5). Here x* is the optimal LP solution for I. 

Corollary 5.14. Let n be in the class &-sm-CSP on alphabet [q] and I be an instance ofU. Then for every 5 > 0, 
assuming the UGC , it is NP-hard to distinguish instances ofU with optimal less than lp(T) + O q (5)from those with 
optimal more than opt(X) - Q q (5). 

The proofs follow verbatim along the lines of their counterparts for the binary case by converting the dictatorship 
function describe above. 



Acknowledgments The authors would like to thank Oded Regev for bringing the paper [AKS09] to our notice and 
also observing that every problem in the class &-sm-CSP over the alphabet {0, 1} can be reduced to a Hypergraph 
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6 Appendix 

6.1 Comparison of our LP with standard LP's for Vertex Cover and Hypergraph Vertex Cover 

We compare the LP relaxation of Figure 2 to the standard LP's for the Vertex Cover and ^-Hypergraph Vertex 
Cover problems. For the Vertex Cover problem, the two LP's are equivalent. Fix an instance I of the Vertex 
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Cover problem. For an edge e = uv, the set A e = {(0, 1), (1, 0), (1, 1)}. Hence, an element of ConvexHulKVl,,) can 
be written as ^(0, 1) + A 2 (\, 0) + A 3 (\, 1) - (A 2 + A 3 , A 1 + A 3 ), where A t > for i = 1,2,3 and £? =1 A t = 1. Now, 
jc u = A 2 + A 3 , x v — A i + A 3 implies that jc h + JC(, > 1 . Conversely, it is easy to check that given values x u , x u > 
such that x u + x v > 1, one can find corresponding /I, values. Thus, the standard LP and our LP for Vertex Cover 
problem are equivalent. 

We now show that the LP of Figure 2 is stronger than the usual LP relaxation for &-Hypergraph Vertex Cover 
. An instance of &-Hypergraph Vertex Cover is specified by a ground set V and a set E c V k . Each vertex u e V 
has weight w u and the goal is to find a minimum weight subset of V which contains at least one element from each 
hyperedge in E. The usual LP for &-Hypergraph Vertex Cover is written as follows : 

minimize w v x v (7) 
veV 

subject to Ve=m,u 2 ,...,u k eE x Ul + ■ ■ ■ + x Uk > 1 (8) 

V ue y x v > (9) 

The set A e for this problem contains all the elements of {0, 1}* except the all zero vector (0, . . . , 0). An element 

(x U[ , . . . , x Uk ) € A e has the property that x tl] h vx Uk > 1 and so the same holds for any element in ConvexHull(A e ). 

Hence, constraints (2) imply constraints (8). 



6.2 Details of Section 3 

We prove Fact 3.2 which we restate below. 

Fact 6.1. Let x be a feasible solution to LP(i~). Then 

1. X s is feasible for LP(J). 

2. val(J, X s ) < val(J, x) + s. 

Proof. We first prove the first statement. It is enough to prove this for x' where x' differs from x on only one 
coordinate u. Fix an edge e — (u\, . . . , u^) and without loss of generality assume that u - u\. Let A&, cr e A e be the 
coefficients in the convex combination of vectors in A e which yield (x U[ , . . ., x Uk ). Let A' e be the set of cr for which 
a x = 0. 

For each cr e A' e , define m{cf) as vector which is same as cr except that cr'j = 1 . Clearly, m(cr) e A e as well. Now 
consider the vector zZa-^A' Ao-o~ + Do-eA' A a m{cr). This is equal to (1, x Ul , . . ., x Uk ). Thus, we have shown that the 
vector x" which is identical to x except that x[[ = 1 is feasible to LP( I). Now note that x' is a convex combination 
of x and x" . Hence, the claim follows. 

We now prove the second statement. Since x £ lt < x u + s, we get that 

val( I, x E ) = ^ w u x £ u < 2^ w„x u + g / \ w u - val(J, x) + s. 

u u u 

□ 



6.3 Details of Section 4.1 

We prove Lemma 4.6 which is restated below. 

Lemma 6.2. Let A be a upward monotone subset of {0, 1}^ and let {x\,x 2 , . . . , Xk) e ConvexHull(A) such that 
each x u is an integral multiple of s (assume that l /s is an integer). Then, there is a distribution P over A such that 
the minimum probability of any atom in P is at least ^fy. 
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Proof. We define a variable A a for every o~ e A e . We want to find a solution to the following : 




(10) 



creA e 



2> = ! 



(11) 



Vo-eA,, 



(12) 



We know that there is a feasible solution to this set of constraints. A vertex solution corresponds to the unique 
solution obtained by subset of the constraints (where inequality is replaced by equality). For a such a system of 
equations, A • A = b, we observe that all entries in A are 0-1 and all entries in b are integral multiples of £. The 
determinant of A is at most 2*!. The value of A a (by Cramer's rule) is the ratio of determinants of two matrices - 
the matrix A with one of the columns replaced by b, and the matrix A. Since each entry of b is a multiple of e, it is 
easy to check that the determinant of the former matrix is either or at least e. This implies the lemma. □ 

6.4 Details of Dictatorship Function (Section 4.2) 

We give a brief introduction to the Invariance Principle in this section. Then we complete the soundness analysis 
(Theorem 4. 10) of the dictatorship function by giving proof of Fact 4. 1 1. 

6.4.1 Gaussian Spaces and Mossel's Invariance Principle 

Measure Spaces. We will be concerned with real valued functions in two measures spaces. 

1. p-biased measure space. For p e [0,1], the p-biased measure on {0, 1}' is denoted by p. p where for x = 
(x u ...,x r ) e {0, l} r ,n p (x) d = p l[i - x ' =l \l- pf :x - =Q]l . For f,g : {0, 1} ^ R, define the following inner product: 

(f,g) P ■= E x <- Mp [f(x)g(x)]- 

def 

2. Gaussian measure space. We will denote by y as the Gaussian measure on R' with density y{x) - 
(2/rr r <V l|t||2/2 for x e R r . For a function /:l r nlwe will denote by E y [f] d = J Rr f(x)y(x)dx. We 
will restrict ourselves to / e L (W, y), i.e., / such that E y [f 2 ] < oo. For /, g : R r i-> R, define the following 
inner product: (f,g) 7 := E x ^ y [f(x)g(x)]. 

Gaussian stability. For p e [-1, 1], we denote by U p the Ornstein-Uhlenbeck operator U p which acts on L 2 (W, y) 

as U p f(x) d = Ey^ y [f(px + yi -p 2 y)]. It is easy to see that E y [U p f] - E y [f]. For < fi < 1, let : R i-» {0, 1} 
denote the function F^{x) = i{ x< t\, where t is chosen is a way such that Eyff^] = p. 

Definition 6.3. Given p,v e [0, 1] and pe[-l,l] define 



For a vector (p\,pi, . . . ,pk-i) £ [-1, 1] A 1 and p\,pi, ■ ■ - ,Pk we recursively define 

def 

When the p,- are all equal to p, and the p, are all equal to p, we will use T p (p) to denote the term on left hand side 
above. 

We will also need the following simple facts. 



r p (p,y) = (F M ,U P (l-F^ v )). 
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Fact 6.4. For every 9 e (0, 1) and p = 1 - A e (0, 1), r p (0, 0) > 1/U . 

We use the above fact iteratively to obtain the following bound. 
Fact 6.5. For every G e (0, 1) and p = 1 - A € (0, 1), r*(0) > 1/ ''\ 

Product Spaces and Influences. Let (Q 1 ,/^), . . . , (Q. r ,p r ) be probability spaces and let (Q,//) denote the product 
space (lli = i nj=i Mi)- Let / = (f\, . . . , fy) : Q 1-> R*. The influence of the z'-fh coordinate on / is denned as 

def Y~i 

Inf,-(/) = > E tyar w [/y(x)|xi,...,Xi-i,ac/+i,...,jc r ]]. 

def 

Here, fixing (xi , . . . , x,_i ) and (xy+i, . . . , Jt r ), //(*) is just a function of xu call it g. Hence, the variance Var Pi . [g] - 
E^ig 2 ] - (E w [0]) 2 . When Q 1 = • • • = QT and / is a boolean function, let {f s : S c {0, 1}'"} denote the Fourier 
coefficients of / with respect to the product measure p. Define the degree-cf influence of the z'-th coordinate on /, 
Inff'CA as S S :/ e 5,|5|<^- 

Correlated Spaces. We now consider a correlated space PonQ'x f2 2 x • • - X with a probability measure p. 

X<—fl [ 



A function / : Q*x 2 x • • • x Q k i-> R is in L 2 (P) if E;c,_„[/ 2 (jc)] < oo. We consider L?{P) as a vector space over 



the reals of all functions in L (P) where addition of two functions is defined as point-wise addition. We denote by 
Var^t/] d = E^[/ 2 ] - (E M [f]f, and Cov[/, g] = E M [fg] - E^f] E^gl 

Definition 6.6. For any two linear subspaces A and B of L 2 (P), we define the correlation between A and B by 

p(A, B; P) = f sup{Cov[/, g] : / e A, g e B, Var[/] = Var[<?] = 1}. 
Now we can define the correlation, p(P) of a correlated space P over Q'x Q 2 X • • • x Q fe . 
Definition 6.7 (Correlation). The correlation p(P) of a space P over O'x H 2 x • • • x Q. k is defined as 

p(P) d = max {piQ 1 x • • • x Q^ 1 x x-xfl 1 , Q 7 ; P)} . 
We will use the following theorems in [Mos08]. 

Theorem 6.8 (Cheeger's Inequality). [Mos08 ] Let {Q} x D. 2 , P) be two correlated spaces such that the probability 
of the smallest atom in Q} X Q 2 is at least a > 0. Define a bipartite graph G = (D. l ,Q. 2 ,E) where (a,b) 6 Q} X fl 2 
satisfies (a,b) e E ifP(a,b) > 0. r/iezi ifG is connected then 

p{Q l ,Q. 2 ;P) < l-a 2 /2. 

Theorem 6.9 (Invariance Principle). [Mos08 ] Let (Yl k j = i P/)» 1 < i < r be a sequence of correlated probability 
spaces such that for all 1 < i < r the minimum probability of any atom in j~|* = i ^/ is af /easf a. Assume furthermore 
that there exists p e [0, 1]* -1 and < p < 1 such that p(Qf, . . . ,Q*;P;) < po and p^! 1 '""- 7 ', Q) ;+1 ""'^; P,) < p ; - 
/or az*z* z, _/. Then for all r\ > f/iere exz'sto r > szzc/z f/W z//, : nj=i — * [0> I]-/ '" 1 < J < ^ satisfy 
max ; j(Inf,(/))) < t f/zezi 

Zc 

.7=1 . 



r p (E[/ 1 ],...,E[^])-7 7 <E 



One may take r — r] \ Q-p*i > 
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6.4.2 Completing the soundness proof of dictatorship function 

We now give the proof of Fact 4.11 which will complete the proof of Theorem 4.10. We first state the statement of 
this Fact below. 

Fact 6.10. 

E[u u€Re f m (z (u) )]>0. 

Proof. Let a = |f and Q e = M s {P x e ). We know that the minimum probability of any atom in Q e is at least 
a. Using Lemma 6.11 proved below, we have that the correlated space induced by Q e on R e has correlation at 

9 1/ k dcf 

most 1 - or. Finally, using Fact 6.5, we know that the quantity T( Pi ... iP )(S, . . . , 6) is at least 5'" = ft. Thus, using 
Theorem 6.9 with rj - P/2, we obtain t = t{j]) and d = d{r]) such that if for every i, lnif d (f£) < r, then 

E[u iieRe f s B(u) }>p-p/2>p/2>0. 

□ 



It remains to prove the following lemma. 

Lemma 6.11. Consider an edge e — (u\,U2, . . . , Uk) € E. Let Q,' denote the set {0,1}, i = I, ... , k. LetS\,S2 be two 
non-empty disjoint subsets of{u\,ui, ■ ■ ■ , u^}. Then the correlated space induced by Q e on (x^jjQ') x (x^^O' ) 

has correlation at most 1 — (fif) ■ 

Proof. Let U denote the set Si U 52- Let Q s e l , Q s e 2 , be the distributions obtained by restricting Q e to S 1,^2 
and U respectively. Let Q. 1 denote the elements in Xj e s , Q. J with non-zero probabilites associated by Q e 1 . Define 
Q. Sl similarly. Construct a bipartite graph onfi S| x D. Sl where we have an edge (a,b) if Q^((a,b)) > 0. We now 
argue that this graph is connected. Indeed, let a e D. Sl and b e Q? 2 . Since Q S e l {a) > 0, (a, 1) is an edge in this 
graph, where 1 is the all 1 vector of the appropriate dimension. Similarly, (1, b) and (1, 1) are edges in this graph. It 
follows that the vertices a and b are connected. Note that for every edge {a, b) in this graph, Qg((a, b)) > |jf. We 
now invoke Lemma 6.8 to finish the proof. □ 



6.5 The Reduction 

In this section, we give the reduction from Unique Games to a problem II in the class &-sm-CSP. We first state the 
version of UGC on which our results rely. 

Definition 6.12 (Unique Games). An instance tl = (G(U, A), [r], {n e } e€ A, wt) of Unique Games is defined as follows: 
G = ( U, A) is a bipartite graph with set of vertices U = U len U U rm and a set of edges A . For every e = (v,w) e E with 
v e U m , w e C/ ri ght, there is a bijection n e : [r] i-> [r], and a weight wt(e) e R>o. We assume that YjeeE wt(e) = 1. 
The goal is to assign one label to every vertex of the graph from the set [r] which maximizes the weight of the 
edges satisfied. A labeling A : U i-» [r] satisfies an edge e = (v, w), if A(w) = n e (A(v)). 

The following notations will be used in the hardness reduction and we state them here. 
Notations. 

1 . For a vertex v e U, T(v) is the set of edges incident to v. 

def 

2. For a vertex v € U, define p v = zZeeriv) wt(<?). This gives a probability distribution over the vertices in U left 
(or U rm ). 
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We now state the Strong UGC which was shown by Khot and Regev [KR08] to be equivalent to the UGC [Kho02]. 

Conjecture 6.13 (Strong UGC ). For every pair of constants r\, £ > 0, there exists a sufficiently large constant 
r := r(n, £), such that it is NP-hard to distinguish between the following cases for an instance 
H = (G(U,A), [r], {n e } ee A, wt) o/Unique Games: 

- YES: There is a labeling A and a set Uq c U m of vertices, zZueUn Pu — (1 ~~ 7 7)» such that A satisfies all edges 
incident to Uq. 

— NO: There is no labeling which satisfies a set of edges of total weight value more than g. 

Now we describe the reduction from Unique Games instance to our problem. The reduction shall use the instance 
D of IT produced by DictS (r, 6). Here x is the e-perturbed solution corresponding to an optimal solution x* to 
lp(J). 

Input Instance : The input to the reduction is an instance H = (G(U,A), [r], {n e } ee A, wt) of Unique Games problem 
as defined in Definition 6. 12. Recall that G is a bipartite graph with U = U len U U, m , and the edge weights wt 
induce probability distribution p v over vertices in U m . 
Output Instance : The output instance T of II is as follows : 

1 Vertex Set V(T) = U m x V(D), i.e., we place a copy of V(D) at each vertex of U len . We shall index a vertex 
by (u, b, y) where u e U m and (b, y) e V(D). 

2 Vertex Weights The weight of a vertex (u, b, y) is 

w r ((u, b, y)) = p u ■ w D ((b, y)). 

3 Hyper-edges For every hyperedge e = [(b 1 , y 1 ), (b 2 , y 2 ), . . . , (b k , y k fj in D, we add the following edges to T 
- for each vertex u € U, m and all sets of k neighbors, u l , . . . , u k (with repetition) of u, we add the hyperedge 
\{u l ,b l ,u l on 1 ! ,J,---,(u k ,b k ,u k o7T u . )] to T ■ The constraint for the these edges is the same as that for 

\ Ui,u ) (u,u k ) j 

e. 



Completeness. 

Theorem 6.14. Suppose there is a labeling A for H and a subset Uq of U m , zZveu Q Pv ^ 1 — i\> such that A satisfies 
all edges incident on Uq. Then there is a subset of vertices in T which satisfy all the constraints in T and has 
weight at most lp( I) + 6 + s + r\. 

Proof. Consider the labeling A. We now show how to pick a set F of vertices from VCF) which satisfies all the 
hyperedge constraints. For each u € Uq, define J u as {{u, b, y) e V(f) : y\ u = 1}. For each u e U len - Uq, define J' u 
as the set {{u',b',y') e V(T) : u' = u). Now define F = U ueUo J u [j U u eU m -u J'u- 

We now show that F satisfies all hyperedge constraints. Fix a hyperedge e = {{b l ,y l ), . . . , (b k , j/fj in D. Let 
u e U rim and u l , . . . , u k be k neighbors of u. Consider a corresponding edge / = ((w 1 , b x , y 1 071* ul ), . . . , (u k , b k , y k o 
n" uu kyi) i n ■ Lemma 4.9 shows that the set C,- = \{b,z) : Zi = 1} satisfies the edge constraint for e for any i. Let us 
pick i = A u . It will be enough to prove that if (b 1 , y l ) satisfies y\ = 1, then the vertex w = (u , b 1 , y l o 7if ^ ) is in F. 
But this is indeed the case because if u l e Uq, then A u = n u ,AA..i). Therefore, u l o n u h has coordinate A,.i equal 

" (um 1 ) u (u,u') 11 n 

to 1. Hence, w £ J l u . If u 1 e U m - Uq, then we add w e J' t trivially. Thus, we have shown that F satsifies the edge 
constraint for the hyperedge /. 

Let us now compute the weight of F. If u e Uq, then Lemma 4.9 and Fact 3.2 show that the weight of J u is at 
most p u ■ (lp(J) + e + 5). If u £ Uq, then the weight of J' u is p u . Thus, the weight of F is at most 

(lp( I) + 6 + e) p u + 2 P" - 'P( J ) + 6 + E + 1- 

ueUo u£Uo 

□ 
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Soundness. 



Theorem 6.15. Suppose there is a subset of vertices F which satisfies all the constraints in f and Wf{F) < 
round(J, x* , e) — 26. Then there is a constant £(e,6,k) such that there is a labeling for 11 for which the set of 
satisfied edges has weight at least g(s, 6, k). 

Proof. Consider a set F satisfying the conditions of the theorem. Let 1^ (■) be the indicator function for F. For a 
vertex u e U, m , let N(u) c U len denote the neighbors of u. Recall that every vertex of T can be written as (w, z), 
where w e U len and z £ V(D). Since the distribution {p w } w eu len is same as first picking a vertex u e U rm with 
probability p u and then picking a random neighbor of u (according to edge weights), we get 

w r (F) = E ueUrm E wmu) E zeV(V) I F ((w,z o 7i" u w) )), 

where z is picked according to vertex weights in £). For a vertex u e U rm , let G(u) denote the quantity 

E E Ifezorf )). 

weN(u)zeV(D)F (u ' w > 

We can therefore state the condition of the Theorem as E„ € (/ right G(u) < round(J, x* , e) - 26. Call a vertex 
u e t/ right good if G(u) < round(J, x* , e) - 6. A simple averaging argument shows that the weight of good vertices 
is at least 6/2. 

Fix a good vertex u. Let be a copy of the instance D. We construct a solution S^ u ' for 2)^' as follows : 
for each (b, y) e V{D {1 ^), we pick a random neighbor u' of u according to edge weights wt in the instance 14. If 
{u\ b,yo tt" ,0 € F, we add (b, y) to S {u) . 

(u,u) 

Claim 6.16. S^ u) satisfies all the constraints in 

Proof. Let e = ufe 1 ,? 1 ), ■ ■ ■ , (b k , y k )^j be a hyperedge in D^"\ Suppose while constructing the set S^ u \ we decide to 
add (b',y l ) to this set based on whether (u', b l , y' o ) e F. Now observe that the instance T has the hyperedge 

|(w ! , b l ,y l o 7t" m . . . , (u k , b k , y k o n" u . Since this hyperedge is satisfied by F, the claim follows. □ 

Note that E[5 (il) ] is exactly G{u), where the expectation is over the choice of random neighbors of u. For each 
vertex w e C/| eft and b e [m], define a 0-1 function f^' w on {0, l} r as follows - 

f F ' w ( ) d = { 1 if b ^y^ F 

h W | o otherwise 

Note that / fo F ' ,u is the indicator function for complement of F for the set of vertices {(«;, b,y) : y € {0, 1}' }. For the 
vertex u, we now define the function f, ' (y) which is the average of the con - esponding functions for the neighbours 
of u. 

Observe that f[' u (y) = P[(m, b, y) 5 ,( " ) ], where the probability is over the choice of S(u). Rest of the proof is very 
similar to the proof of Theorem 4. 10 - the goal would be to prove the following statement : 

Lemma 6.17. There exist values b e [m],i € [r] and constants d,r depending on 6 and k only such that 
lnSf(f[' u ) > r. 
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Proof. Let r and <i be as in the proof of Fact 4.1 1. Suppose, for the sake of contradiction, that the statement of the 
lemma does not hold for these values of t and d. Define 

jM«gi bl E f^( z )<s). 

Let Ty^ d = f U beJU ,)(b, {0, 1}'). Fix a particular hyperedge e - (a\,ai, . . . ,a^) 6 E of the instance I (which gets used 
in Dict" (r, 8)). Let 

R e u) = {at e e \B(tn) t J {u) l 
The following fact can be deduced in the same manner as the proof of Theorem 4.11. 
Fact 6.18. 

En ^<<*^ (a) )>o> 

where the expectation is over the choice of Zr* from pB( a ybiased measure on {0, l} r . 
Fact 6. 18 implies that there exist neighbors u" e N(u) for each a e Rg such that 

E n (e </^)(^ ) °< 1 ,))>0- 

Therefore, there exist values : a e Rg }, such that (z^ o n" u ^) = 1 for all a € R^. But then consider the 
following choice of S (u) : while considering (B(a), v"'), we pick the neighbor u a of u. Therefore, the set does 
not contain any element from the set {(B(a),z^ a) '■ a e R e }. The set still satisfies all the constraints in Tf u) 
(Lemma 6.16). Hence, there exists a hyperedge ((b^,z l ), ■ ■ ■ , (b k ,z k )) in D" corresponding to e which gets satisfied 
by Tj only. Thus, all hyperedges in are satisfied by T ( f . But w D (T {u) ) > round(J, x* , e). Further, we know 
that 

E w v (S (u) ) = G(u) > wv(T ( j ] ) - 5. 

This contradicts the fact that E w^S^"' < round(J, x* ,e) - 8. Hence, the lemma is true. □ 

The rest of the argument to complete the theorem follows standard arguments, see e.g. [Rag08]. □ 

Choice of Parameters and Proof of Theorem 1.1 Given parameters s and 8, and a constant value k, we first pick 
tj according to the proof of Fact 4.1 1 described in Section 6.4.2. The parameter 77 can be assumed to be much less 
than 8 (otherwise we can just set 77 to be 8). This yields the parameters t and d as specified by Lemma 6.17. Then, 
as in [Rag08], £{e,8,k) mentioned in the statement of Theorem 6.15 depends on r,d,8, and hence, on e, 8 and k 
only. Now we pick the label size r of the Unique Games instance 1A to be large enough such that we get a gap of 
1 - (77 + s + 8) versus £ in the UGC . Theorems 6.14 and 6.15 now imply Theorem 1.1 if we pick the values 8 and 
e in the reduction to be half of the ones mentioned in the theorem. 
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